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Abstract 


Compared with DST, DSmT can be good evidence of contradictions to resolve the issue of evidence portfolios, In 
view of the occluding in tracking dynamic targets in complex background, a new anti-occluding target tracking 
algorithm based on DSmT and particle filter is proposed by color cues. The simulation results show that the proposed 
algorithm is effective and practicable in tracking occluded target and intersected target. Compared with the existing 
combination rules, the newly proposed rule is applied to both cases of conflicting and coincidence. 


© 2010 Published by Elsevier Ltd. Selection and/or peer-review under responsibility of Society for 
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Keywords: DSmT; color cues; dynamic targets; tracking 


1. Introduction 


The visual object tracking is a key issue in many vision-based applications, such as visual surveillance, 
visual navigation of robots, human-computer interaction, medical diagnose and military guidancel”!. 
Along with the rapid growth of the information techniques in the last tens of years, the object tracking has 
attracted many researchers’ attention and has become a very popular research topic. Although many 
effective visual object tracking methods has been proposed, there are still a lot of difficulties in designing 
a robust tracking algorithm due to the challenging complex scenarios such as significant illumination 
changes in environment, pose variations of the object and non-linear deformations of shapes, and noise 
and dense clutters in complex background, etc. DSmT is a useful method for dealing with uncertainty 
problems'*!, It is more efficient in combining conflicting evidence; therefore it has been successfully 
applied in dynamic targets tracking. 
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In this paper, a tracking algorithm based on the DSmT theory is proposed by adapting color cues. The 
dynamic tracking model with the major colors cues of the targets is built so that the targets can be 
represented with a few of the model parameters, and its performance is superior to the histogram used 
widely in targets tracking. The proposed tracking algorithm can track targets robustly in complex 
scenarios such as appearance change and occlusions by different tracking experiments. 


2. Dynamic Targets Tracking 


Highly non-linear and non-Gaussian estimation problems are ubiquitous in target tracking. Particle 
filters (PF) is an effective tool for such problems, and the basic theory of PF can be founded in literatures 
[3,4]. In order to handle real-time tracking problem effectively under occlusion conditions, and degrade 
the uncertainty, non-integrality and indefiniteness. A key technique in information fusion and several 
tracking problems under occlusion condition are studied based on the framework of PF and DSmT, and 
the corresponding model will be established in this paper, and a general framework for dynamic targets 
tracking using color cues will be described. This approach uses the DSmT combinational rule to refer the 
information provided by the color cues into a single representation, and this latter takes into account the 
conflicts between the cues that might arise due to occlusion. 

Let’s assume that the number of targets is t, the number of cues is c, and the t and c are known. Up to 


time f-1, each target is associated with a track {g Me . At time ft, an image frame is extracted from the 
JJ j=1 


video sequence and a number of measurements are obtained for each target candidate. A single map 
function can be derived as follows based to DSmT combinational rule. 


mi (A)= mP OO mi) = O miv(). (1) 
Where ny (Ais the overall confidence level with, which all cues associate particle n to hypothesis A at 


time t. 
Since the target candidates must be associated to individual tracks, the information contained in 
compound hypotheses is transferred into single hypotheses through the notions of the belief or plausibility 


functions”. 


Bel (0) = F miP(A)’ a 
OSA 
Aep® 

Pls e) = m (A) (3) 
OCA 
Ae D? 


Where Bel” (6,) (resp. Pls "gg quantifies the confidence with which particle n is associated to 6; at 


time t using the notion of belief (resp. plausibility). The confidence levels are not used to determine 
whether a given a candidate is the best estimate or not of the target, they are rather used to quantify the 
weight of the candidate as a sample of the state posterior distribution p(X,|Z,). The particle filtering 
algorithm based on DSmT is implemented in this paper, and the corresponding step is given below. 


Step 1: Initialization—generate N samples §, , = hm, ae JA for each target j=l, + ,z 


independently, with i =1/N , and set t=1. 


Step 2: Propagation— Se -A-§ ae r w”, 


Step 3: Observation (for each particle)—Compute {m ae A)} and {m 4 ( A)} for AG D®, and 


c c 
l=1 l=1 
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~ (n) 
Calculate the particle weight a = Bel. 4 (0, ) , Normalize the weight: 7 a: = a 


n=l- t-J 


N 
Step 4: Estimation—Target j=1...t is given by E[S; Te- X AA 
T 
n=l 


Step 5: Resampling (for each target)—Generate S 


t, j 


(n) _ (n) jaz = (1) 
p\s t, J =O zJ M oJ 


Step 6: Incrementing—when t = t + 1, go to step 2. 
3. Color Cues for Tracking 


For two targets, we can define © as follows 
@=10,,0,.0, UG}. (4) 

In (4), 0, refers the first target, 6. refers to the second target and 0. UO, refers to the rest of the scene. 
Actually, hypothesis 6 U0, can refer to the background information. However, since this latter can 
change during the tracking, we will refer to 6. U0, as the false alarm hypothesis. Beside, 
0, (10, # due to the possible occlusion, and 0 j N 6 UO, =@ for j=1,2. 

Let’s assume that both target models are known and given by normalized color histograms lq j DY, l 
where u is a discrete color index and m is the number of histogram bins. At time t, the normalized color 


histogram of particle s” 7 is given by fne Ut, . The probability that particle o ? belongs to target j=1,2 


according to the color a gram is derived from the following Gaussian pdf. 
[any 
p= ae = 1.2. (5) 


"xo 


where o is a color bandwidth parameter, e is the Bhattacharyya distance between hy” (u) and q ,(u) at 








time t. 


d? = 1-0" hi (ug, (u) . (6) 
Let’s define fq os (u)f ‚as the histogram of the scene from which we subtract the histogram of targets 
1 and 2. 








qra) = MAX soene (u)— qu) — q, (u),Of. (7) 
The probability that o belongs to the false alarm hypothesis will be given by 
lap) 
py =a——e e, (8) 


270 
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m 
Where dep, =f1-— "hi" (Ww) gy, U) 
The mass functions of particle n according to color can be evaluated as follows 
(n) 


n\/A TID P,, 
m°} (0, U 0,) = => i (9) 
Pia z3 Pia + P; FA 
(n) 
m0.) = Poi =i (10) 
277) my pin), pm 7d ~ se: 


Pii + Piz + Pi FA 


4. Tracking Experiment and Analysis 


In order to test tracking efficiency and correctness, two different videos with the same scene are 
selected to compare the introduced method, as shown in figure 1 and figure 2. There are only two people 
in the first video, and there are many people in the second video, and two intersecting targets will be 
marked. 








Fig.1 Two targets of the first video Fig.2 Two targets of the second video 





Owing to the increased number of particles will increase the processing time, 20 particles are using to 
dynamic targets tracking in the first video by the above analysis, and 30 particles are given to meet the 
accuracy of dynamic tracking in the second video. The dynamic tracking process of main frame is given, 
and figure 3 is the first video and figure 4 is the second video, respectively. 





— oe 
Fig.4 The tracking process of main frames in the second video 


At last, the dynamic tracking result of intersecting targets in cluttered scenes is gotten, and figure 5 is 
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the first scene and figure 6 is the second scene, respectively. 





Fig.5 The result of intersecting targets in the first video Fig.6 The result of intersecting targets in the second video 


It can be seen from the above tracking process, the introduced method accurately identifies the targets 
during the three phases of the tracking. This is due to the effective handling of the conflicting information 
provided by the color cues based on the DSmT. 


5. Conclusion 


Highly non-linear and non-Gaussian estimation problems are ubiquitous in dynamic target tracking, 
and it is a tough job to select the characteristics of targets in target tracking system. If targets have more 
features, tracking accuracy could be improved effectively. However, computing quantity and calculation 
time would also be increased. It is imperative for us to take compromise of real-time and accuracy. As 
high stability and low computation al characteristics, color cues are become main information, and it can 
be used to establish dynamic targets tracking model based on DSmT with the DSmT is very effective 
evidence theory for such problems. The experimental results have been demonstrated that this method 
ameliorated the interference immunity of the traditional model for tracking targets. The introduced 
method improved the tracking accuracy and robustness while not affecting the real-time characteristics, 
and it have better dynamic tracking effect for different scenes. 
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